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1. INTRODUCTION \2. 79 

cop. 3 

This report introduces, documents, and illustrates the syntactic 

description of the ALGOL programming language required for the compiler- 

2 
compiler (compiler~) system being developed for the IBM 7094, ILLIAC II, and 


ILLIAC III computers. 


Translators constructed by the coupi ler: use a variant of Floyd 
Productions [1,3] to effect syntactic analysis. The general applicability of 
this method of syntactic analysis is dependent upon the successful development 
of a language-independent loader and subscan system, The productions described 
in this report have utilized the system fully described in the paper by 
Northcote and Steiner [7]; consequently, details of the operation of the 


syntax loader have been omitted. 


This report is an extension to the full Revised ALGOL language [5] 
of the work done by Feldman [2], who listed a production language system for 
SMALGOL--a considerably simplified subset of ALGOL. The production language 
used here follows closely that used by Feldman, which, in turn, is a variant 
of the technique devised by Floyd [3] and later used in another variant by 
Evans [1]. 


The productions described below have been designed for the syntax 
analysis of a program written in the Revised ALGOL language as defined in [5]. 
In addition a few of the extensions found in Extended ALGOL for the Burroughs 
B5000 [8]. have been included as possible extensions to an implementation of 
the language. In accord with the Revised ALGOL report, no 1/0 operations have 
been included at this stage, but this extension should present no serious 
problems. An extensive analysis of syntactic errors has been included. A 
Significant extension from the Feldman scheme is the addition of error 
recovery routines. Some attention was devoted to the problem of recovery 
after an error where the aim has been to check as much of the program as 
possible despite errors. Where at all possible, direct corrections are 
attempted for most common errors, but in a language as flexible as ALGOL, it 
is not always easy to deduce what the programmer may have had in mind and a 


less ambitious recovery is often necessary. 


2, THE PRODUCTION LANGUAGE 


The production language is based on the model of a recognizer with 
a single pushdown stack. The syntax of the source language, when written in 
the production language, will specify the behavior of the recognizer as it 
scans an input text in the source language. The Subscan System ([7], Chapter 6) 
assembles the characters scanned in the input string into syntactic units, or 
symbols, of the source language and pushes the corresponding production symbol 
into the MAIN-stack (of the recognizer). The sequence of symbols at the top 
of the stack is compared with the allowable configurations of the source language 
being translated. When the symbols in the stack match one of the allowable 
configurations of the source language certain actions are performed on the 
stack, If a match is not obtained the stack is compared with the next production 
language statement, i.e., with another allowable configuration. This process 
is repeated until a match is obtained, which may eventually be a "forced match" 
with any symbol. This latter case often implies that the sequence of symbols 
in the stack does not correspond to any allowable sequence in the source 
language and hence is a syntactic error. The funetioning of the receguiaes 


will be discussed more fully bellow. 


The production language program is read in under control of the Main 
Control Sequence (MAIN) ([7], Chapter 4) and the data card: format for the 
production statements is described in Northcote and Steiner Chae Chapter 3, 


Sec. Ie) 


2.1 Operation of the Productions 


The format of a statement (or production) in the production language 


is given below 


Exe- Para- Transfer 
meter 


fabels SL54> by ais, eee ein 


eel Ther Letts 


In this format the first vertical bar from the left represents the 
top of the stack in the recognizer. The symbols Ll, ..., L5 (Left 1, ..., 
Left 5) @enote the top, ..., fourth from top positions, respectively, in the 
stack, and designate comparisons to the corresponding position in the MAIN-stack, 
Seeeeeiven production the symbols Ll, ..., L5 will be the production symbols for 
punctuations (listed in the symbol class *PUNCS), reserved words (listed in the 
symbol class *RESER), nonterminal or production symbols (listed in the symbol 
*NONTR), metaclass names (listed in the symbol class *META) or may be blank. 


If the symbol field contains a metaclass name the corresponding stack 
MOsrtion is tested to check if the syntactic element in the stack is a member 
Of the piven metaclass. If the field contains one of the other types of 
production symbols the corresponding stack element is tested for a match. If 
the field is blank, this position is not tested, Only the top n symbols 
ri SS 5) need be present, and are compared with the top n positions of the 
MAIN-stack during translation. The symbols Ll, ..., L5 represent the “allowable 
configurations" mentioned above--each “allowable configuration" constitutes 


one production statement. 


A match occurs when the actual symbols in the MAIN-stack during 
translation are the same as the corresponding symbols in Ll, ..., L5 in the 
production being compared (or if any of the symbols ll eictkie 9 tue bee Metaclass, 
when the symbol in the stack is a member of this metaclass), The metaclass 


(SG) represents "any symbol" and is always matched, 


Betee the Rights 


When a match occurs the remaining information in the production 
Btavement is used. The * following the first bar specifies the stack is to 
be changed. The symbols Rl, R2, R3 (Right ie ave, Right 3) denote the 
symbols which are to occupy respectively the top, first from top and second 
from top positions of the stack after the change. For example, suppose that 
in a given production the top n symbols (1 <n <5) of L5, ..., Ll are non- 
blank, and a match has occurred. If the * appears and all the Right fields are 
blank, then the top n elements of the MAIN-stack are popped, and translation 
continues. However, if the * appears and the top m symbols (a <n 3) on: nS), 


R2, Rl are nonblank, then the top n elements are popped from the MAIN-stack as 


-3- 


before, and the m elements from R3, R2, Rl are pushed into the MAIN-stack so 
that the symbol from Rl is now the top of the MAIN-stack. If the * does not 


occur no manipulation of the MAIN-stack takes place. 


2.1.3 he Executes 


In the "Execute or Action" field, after the second bar, either an 
integer or a mnemonic name may appaar. Blank fields are ignored. A nonnegative 
number calls for the execution of the corresponding Formal Semantic Routine 
written in FSL [2,6] which leads to the generation of code for the construct 
recognized in the source language. The memonic calls for a small fixed 
subroutine in the compiler”, e.g., ERR calls for the printing of an errem 
message. However, this field and the parameter field (which contains a para- 
meter for the mmemonic action call, e.g., numerical identification of the 
errors ) do not directly affect the operation of the productions and furiier 


details may be obtained from [7]. 


ai Transmem held 


The final field of the production statement is the transter 2. ee 
which contains a label. If a match is obtained, then after stack manipulations 
and executes (if any) have been completed, control is transferred to the 
production statement denoted by the label found in the transfer field. (Note 
that the label of a production statement is found in the first field aa eaens 
in the format above.) If the transfer field is blank then control auto- 
matically passes to the next production statement. If the transtéer treme 
contains a label (at least one nonnumeric character), then the next production 
considered is that having this label in the label (left-most) field. If 
the first character of the transfer field is * “then, before transferring 
control as described above, a call is made to the Subscan System ([7], 

Chapter 6) which assembles the next symbol from the input string and pushes 
this symbol into the MAIN-stack. 


3. THE LISTING OF THE PRODUCTIONS 


Initially the five symbol classes are listed (see Appendix). 


3.1 The Symbol Classes 
3.1.1 *PUNCS 


All the simple punctuation marks, together with their associated 
internal numbers (in both decimal and octal) are listed in this class. For 
symbols in all of these classes, the internal number of each symbol Guay 
Chapter 2) is used by the loader to identify the symbol instead of using the 
symbol itself. The external symbol field is blank since the external symbol 


is the same as the production symbol in this class. 


3.1.2 *RESER 


This class contains all the reserved words of ALGOL and the compound 
punctuation marks, In most cases the production symbols of the reserved words 
of ALGOL are merely the internal symbols with the apostrophes deleted and then 
truncated to four characters. Since the names of the standard functions are 
not enclosed in apostrophes these are simply truncated to four characters. 


Note that integer division has the production symbol DIV, 


Three additional symbols are included in this class. The symbol 
as revurned by the subscan if the symbol scanned in the input string is 
not an allowable symbol in the source language. The symbols P* (Procédure 
identifier) and FD* (Function designator) have been included in this symbol 
Glass <6 facilitate their use in a metaclass. These identifiers have been 
given special symbols to explicitly denote the difference between a regular 
identifier and one denoting a procedure call. (Note that the procedure 


declaration may have had an empty parameter part.) 


3.1.3 *NONTR 


This class contains all the nonterminal or production symbols. 
These symbols are used in the productions at intermediate stages of the 
Syntactic analysis and do not appear in the source language. The meaning of 


each symbol is listed in the column "comment." 


/- is the terminator symbol, Five of these are placed in the MAIN- 
stack before commencing the processing of the program. When only the terminator 
symbol and "FINIS" appear in the stack, all the statements of the source 
language program have been digested by the productions and processing should 


Cease. 


HEAD is the block head which denotes the beginning of a new block. 
It distinguishes between "BEGIN" used to start a block and "BEGIN" used merely 


as a statement parenthesis. 


SP is a step element which is introduced simply as a convenient 


contracted notation for the symbol sequence "STEP I" in a FOR clause. 


FDD is a function designator declarator. This construct has been 
given a special symbol because for a procedure declaration to define the value 
of a function there must, within the procedure body, occur at least one 
explicit assignment statement with the procedure identifier as a letiepaer, 
This notation has been introduced to facilitate the trapping of a semantic 


Guargoig alab | qlalalis) eXopayolatqegaleyal als} along ines. 


ARRX denotes an array declarator when the lower bound of an element 


of the array declaration as to be scanned: 


D( is the left parenthesis of a designational expression. The left 
parenthesis has been denoted by a special symbol in this case to assist in the 
decision as to which part of the productions we should return after scanning 


an IF clause, 


The remaining symbols have their usual meanings as defined in the 


Revised ALGOL report [5]. 


3.1.4 *META 


This class lists all the metaclass names used to denote classes 
of symbols, The description of each metaclass is listed under "comment" 
and the contents of each metaclass are listed as additional symbol classes 
after the symbol class *ACTWD. The first four metaclasses (viz. (SG) = any 
symbol at all, DIG = digit, LET = letter, PUNC = punctuation mark) are used 


in the Subscan System [7] and except for (SG) are not used in the productions, 


sae 


3.1.5 XACTWD 


The action word list is a list of the mnemonic names by which those 
executes which have been predefined in the system (called actions), will be 
called in the productions. Only ERR (=Error) and HALT (to terminate processing 


by productions ) are used in this particular production system, 


3.1.6 *EQUIV 


The final symbol class is the Equivalence Declarations, but these are 
not listed until after the productions have been processed, If an external 
symbol has two equivalent forms then the corresponding production symbol is 
listed in this class together with its alternative tolerated form in the external 
symbol field. For example the symbol for the relational operator "less than" 
is "LS." However, a tolerated hardware representation is "'LESS'" and this 


fieecrst0orm is listed in this class so that it will have the equivalent meaning. 


After *ACTWD the contents of each metaclass are listed, and finally 
the beginning symbol (or terminator symbol described above) is defined using 


the control word BEGSYM, 


The hierarchy table described by Northcote and Steiner Chyae Chapter 2, 
Section 3.2) is not required in this production system as the hierarchies are 


implicit in the productions themselves, 


3.2 The Productions 


The production statements are listed one to a line. Each numbered 
ecard image is enclosed in the $ symbols, An asterisk in the first colwm of 
the card (immediately ater the first $ im che listing) denotes a comment 
and this line is ignored. The pseudo-instructions generated by the productions 
processor *RULER are listed after the production statement. These instructions 
designate the type of activity to be undertaken in each production by the 
interpretive subroutine of the Basic Compiler Gi valy Chapter ae The description 
and operation of this order code is documented by Northcote and Steiner Cirle 


Chapter 3, Section 1.4). 


3.2.1 Error Recovery Routines 


Following the productions for the source language ALGOL, are the 
error recovery routines which are also written in the form of production 
statements. The error recovery follows some of the basic ideas of Evans Ba 
but the classification of errors has been expanded and some effort has been 
made to correct or recover from the error directly so that as much as possible 
of the program may be checked, and the great majority of syntactic errors 
detected on one pass. For example, if an errer occurs in an aritimetie 
expression, an initial attempt is made to correct this error (without introducing 
extraneous errors) so that the remainder of the arithmetic expression may be 
analyzed. If this attempt is unsuccessful then the input string is searened 
for the next statement terminator, the stack is manipulated to introduce a 
"statement," and processing resumes at the beginning of the next statement 


alia “whale, akiahoybhe, ‘Shreaealvayes 


This procedure has proved successful with the test programs used) to 
date. However, exhaustive testing of the more subtle errors is dependent to 
a certain extent on the semantic analysis, which is the next stage of the 


2 
compiler project. 


The Subscan productions ([7], Chapter 4) are listed after the error 
recovery routines, followed by the label table with the octal and decimal 
location of each label. Finally there is a listing of the symbol class *EQUIV 


as noted above (Section 3.1.6). 


h, THE EXAMPLES 


A trace has been included with the output from the productions so 
that all the essential steps of the processing of the source program by the 
productions, may be followed through in detail. The routine TRACER eel: 
Chapter 7, Section 1.2) prints the location (octal) of any "Action" or 
"Transfer" which is executed by the system as the productions process the source 
program, In addition, after the return from the Subscan mode, the TRACER 
routine prints the location of the HED (beginning of a new production) to 
which control has been transferred. These locations are listed in the rows 


headed by the word TRACE in the listing. 


Jg2 


Associated with each TRACE row, is a row of (octal) numbers headed 
by LIST. This is a record of the value of the MAIN-stack pointer when the 
associated rule in the TRACE row is executed. The value of the stack pointer 
is always odd as it points to the next available cell in the MAIN-stack, and 
is always incremented or decremented by two. Since there are always five 
terminator symbols in the stack (which implies ten locations used--one 
syntactic word and one semantic word for each symbol), the initial and final 


value of the stack pointer will always be 13 (= decimal Es 


Hence the trace routine indicates every match obtained by the 
productions and also every transfer to a new location which interrupts the 
normal sequential steps through the productions. Every time a trace location 
Beepeincca, the value of the stack pointer at this time is printed directly 
below in the associated LIST row, allowing a determination of the number of 


symbols in the stack at each stage. 


4,1 Example 1 


this is an example of a syntactically correct program which was 
chosen to illustrate how some of the more common constructions in ALGOL are 


processed by the productions. 


As an illustration consider the assignment statement on card number 


15 
ee ey Le ewe eet x (sr /) = xX (/ 17) )* 2 ., 


weet ire. tew Clements of the trace row below this are the final steps in the 
Precescips of the IF statement on the previous card. The seventeenth element 

in this row is 0672 which is the transfer to the HED at the beginning of the 
statement scan (line 136 in the productions), We have an identifier in the 

top of the stack (the first symbol in the assignment statement is the identifier 
H). The next element in the TRACE is 0677 which is the location of the action 
eee line 13/ of the productions, i.e., a match was obtained at line 137 of 
the productions, The location (0700) of the transfer ITS on line 137 is the 
next element of TRACE as expected. The transfer field of line 137 contains 


*S2, i.e€., scan another symbol and then transfer to the production labeled S2, 


Hence, the next element of TRACE is 6407 which is the location in the Subscan 
at which the next symbol (=) was matched. Note that value of the stack 
pointer (in the associated LIST row) has increased from 33 to 35 at this 
stage indicating one more element has been placed in the stack. The next 
element in TRACE (0737) is the location of the HED of the production labeled 
S2 (line 148 in the productions), and sequential checking of the stack against 
the productions will resume from this production statement. Since the top 
two elements of the stack are now "I =", visual checking of the productions 
following line 148 will indicate that a match will not be obtained until 

line 153 and so the next element of the TRACE is expected to be the location 
(1003) of the action IAC on line 153, followed by the location (1004) of the 
transfer ITS on this line, The transfer field of this» production contac. 
*E5, so another call is made on the subscan (6363 in the TRACE and the stack 
pointer increases to 37 when the new symbol I is brought into the stack), and 
then a transfer to the location (2501) of the HED of the production labeled 
E5 on line 313. Since the stack now contains "I = I", a match is immediately 
obtained and the location (2505) of the transfer ITS on this line is printed 
in TRACE, The transfer field of this production indicates another scan and 
transfer to E5A. The next seven elements of TRACE indicate the processing by 
subscan to bring the next symbol * into the stack. 2511 is the location on 
the HED of the production labeled E5A on line 315. The stack now contains 

"TI = I *" and a match is obtained on line 318 since * matches (SG) which is 
any symbol at all. Hence the location (2547) of the transfer ITR on line 318 
is the next element in TRACE. This production designates a transfer to E2 
(line 17S aim “che productions ) whose HED is at location 1114 and so the latter 
is the next element of TRACE. 


Following through the trace in this manner, the precise steps taken 
by the productions in processing the program may be checked in detail. A 
less comprehensive analysis may be obtained by checking the OUTPUTS which 
gives a list of all the "Execute" numbers (in octal) of all the productions 


which were matched, but note that not all productions have "Execute" numbers. 


At the end of the program listing there are a series of dumps. The 
contents of the MAIN-stack are dumped from the top down. When the system 
has operated successfully this should contain only the five terminal symbols 
/- which were placed there initially. The values of the indicators following 
the dump of the. MAIN~stack are related to the operation of the loader and can 
be ignored. Following this there are dumps of the strings, octal constants (OTAB), 


-10- 


floating-point constants (ETAB), and fixed-point constants (ITAB) used in the 
program, Finally, there is a dump of the primitive symbol table (all symbols 
initially declared in the system together with all the new symbols used by the 
program) with the internal number (in decimal and octal) associated with each 
symbol, The third column of numbers in this table will contain the semantic 
information associated with each symbol when the semantic analysis is included 


in the Beeekier” system, 


4,2 Example 2 


In this program a number of syntactic errors have been deliberately 
introduced so that the operation of some of the error recovery routines may 
be traced. The operation of the TRACE, LIST and the final dumps are the same 
as in the previous example. When a syntactic error is detected the error 
message "*** SYNTAX ERROR ***" is printed, To obtain further information 
about oe error, the next line of OUTPUTS is checked to find the occurrence 
of the word "ERROR." The number following "ERROR" in the OUTPUTS is the error 
number in octal, Following the error number is a dump of the MAIN-stack from 
the top down. The semantic information (the number following each symbol in 
the dump of the stack) associated with each symbol can be ignored. The last 


five symbols in the stack must be the five terminator symbols, and these are 


followed by the card number on which the error occurred. 


Consider the first occurrence of the error message in the listing. 
The following line of OUTPUTS indicates this is an instance of "ERROR 12" 
(= ERROR 10 decimal) and after the dump of the stack is the indication that 
the error occurred on card number 3. Referring to the listing of the error 
recovery routines in the productions, "ERROR 10" (line 536) occurs because 
"An identifier did not follow the ',' in the parameter list." Reference to 
the parameter list on the image of card number 3 in the listing of the source 
program shows this to be the case. The details dof the recovery from this 


error may be followed through from the trace as before. 


Reference to the line of OUTPUTS following the second error message 
indicates this to be an occurrence of "ERROR 14" (= ERROR 12 decimal). This 
error also occurred on card number 3 as indicated after the dump of the stack. 
"ERROR 12" (line 546 in the listing of the productions) is indicated because 


"The ')' following the parameter list is not followed by a semicolon." 


-ll- 


In this manner the reason for each occurrence of an error message 
may be determined and the recovery from the error may be followed on the 


TRACE in the usual way. 


5. SUMMARY 


It would appear that a system of rigorous syntactic analysis using 
the production language can be developed fairly easily from a specification 
of the source language in Backus Normal Form. However, such a general trans- 
literation would not necessarily be the most efficient. For example, in the 
present system subscripted variables whose subscripts consist only of simple 
variables have been isolated from the more general case in which the subscripts 
may be arithmetic expressions. In programs in which it is applicable this 


modification improved the speed of the analysis by up to 20 per cent, 


The next step in the development of this system is the semanzac 
analysis which will use the Feldman Semantic Language [2, 6] or some 
modification of this. No attempt has been made at this stage toward 
optimization of the compiled code [4], since it is felt that any steps in 


wlaalis) Clalageyergal(Ojyal Ehets) 1aSllehesCl qo) Was Seitemnoie eiaellhySsis- 


This system has been tested with a variety of test programs and, 
when the printing of the "TRACE" is omitted, the average speed of processing 
is about 1100 cards per minute. However, an improved version of the syntax 
loader is being developed and this is expected to provide an improvemenGan 


speed of at Jeast 50 per cent, 


-|1)- 
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